Method, device, and system for testing video quality

ABSTRACT

A method and apparatus that tests video quality includes a superimposing of at least one code to a video that is to be transmitted by a communication device to another communication device. The at least one code is transmitted such that the superimposed at least one code is extractable and readable from the decoded video by the device that receives the transmitted video. The extracted at least one code may then be read to determine the quality level of the transmitted video. The determination of quality for the received video may be based upon one or more tests performed using at least one code extracted from the received video.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/263,847, which is a continuation of U.S. patent application Ser. No.14/402,410, which is the United States national phase under 35 U.S.C. §371 of PCT International Application No. PCT/US2012/047951, filed Jul.24, 2012.

FIELD OF THE INVENTION

The present invention relates to communication systems, such ascommunication systems that utilize cellular phones, mobile computerdevices, tablets, laptops, other types of terminal devices and othertypes of communication devices. More particularly, the present inventionrelates to a system, method and device configured to permit acommunication device to extract at least one code superimposed in one ormore frames of a video that was received by that device and thenevaluate any extracted code by running one or more tests to assess avideo quality of the received video.

BACKGROUND OF THE INVENTION

The use of video transmissions has grown in the telecommunicationsindustry. But, the testing for the quality of such video has failed tobe updated to account for this growth. Traditionally, technicians testedvideo transmission and reception of video with the aid of still imagestaken from a received video. The load test environment for testing ofvideo quality is often challenging as there are limited resourcesavailable for such testing as a load generator typically allocates alarge percent of its resource in generating calls or communicationconnections for transmitting data.

Quality of video tests includes testing for transmission aspects andcontent aspects. Some transmission related issues that affect videoquality include packet delay, packet jitter and packet loss. Contentaspects that may affect video quality include content encoding andcontent decoding. Transmission issues may be addressed in data packettransmission control. Content aspects, however, can be more challengingto address. Current resources allocated to such testing often fail topermit video quality of content aspects of the video to be effectivelyand proficiently evaluated for assessing video quality.

We have determined that a new method, system and device are needed forimproving the ability of video quality to be tested in telecommunicationsystems and devices used in such systems. We have determined thatembodiments of the method, system and device are preferably able topermit at least one code to be included within a video to be transmittedand subsequently extracted by a device that receives the transmittedvideo such that the code can be evaluated by one or more tests to assessthe quality of received video by the device that receives the video.

SUMMARY OF THE INVENTION

Embodiments of a system, apparatus, and method are provided herein thatprovide mechanism by which video transmitted between communicationterminals may be tested. The testing may be used to identify one or moreparameters associated with video quality to determine a quality level ofvideo that may be transmittable between different communicationterminals along a communication path by which the video was transmitted.The testing may also be utilized to perform network maintenance byidentifying nodes of a network that need upgraded or replaced or byidentifying metrics that can be assessed for evaluating whether anetwork is providing a predefined level of performance.

An embodiment of a communication system may include multiplecommunication terminals such as a first communication terminal and asecond communication terminal. The second communication terminal may bea communication connection with the first communication terminal. Thefirst communication terminal may superimpose at least one code within atleast one frame of a video to be sent to the second communicationterminal via the communication connection and then send the video withthat at least one frame with the at least one superimposed code to thesecond communication terminal. The second communication terminal mayreceive the sent video and extract the at least one code from the sentvideo to evaluate at least one parameter of the video indicative of avideo quality of the sent video.

Examples of the one or more parameters of the video indicative of avideo quality may include image resolution and frame rate. Of course,other parameters related to video quality may also be assessed.

The first and second communication terminals may each be any of a numberof different types of communication endpoints. For instance, thecommunication terminals may each be a cellular phone, desktop computer,workstation, laptop computers, mobile telephone, internet appliance,tablet, a telephone device, a personal digital assistant, or other typeof computer device.

The communication connection between the first and second communicationterminals may be any of a number of different types of connections. Forinstance, the communication connection may be a direct connectiondefined by a direct wireless transmission between the terminals or via awired transmission path that consists of a wired path defined directlyfrom the first communication terminal to the second communicationterminal. As another example, the communication connection may include anetwork connection that involves a transmission path that includesmultiple hops at different network nodes such as access points, switchdevices, base stations, or other network elements. The networkconnection may include a wired path, a wireless transmission path, or acombination of wired and wireless transmission paths.

In some embodiments of the system, the video that is sent by the firstcommunication terminal is sent prior to establishing a video call or avideo conference call to determination a resolution level of the videoto be transmitted during that call. The at least one code may be any ofa number of codes. For instance, one type of code that is used may be aquick response code.

The at least one frame of the video may be any of a number of differentframes or frame types or frame type combinations. The number of framesthat have superimposed codes may be any of a number of different typesand configurations for use in any of a number of different predefinedtesting methodologies for example. As one example, the at least oneframe may include one frame that is an intra-coded picture frame of avideo, or I-frame of the video. As another example, the at least oneframe may be a plurality of frames and the at least one code may be onecode that is separated into multiple fragments. A respective one of eachof the fragments may be included in a respective one of the frames ofthe video. As yet another example, the frames may comprise numerouscodes that each contains multiple different codes containing the samecontent at different sizes for purposes of providing a parameter of thevideo along with an indication of a level of error associated with thetransmission of the video. It should be understood that each of theframes of the video that has at least one superimposed code may be anintra-coded picture frame, a predicted picture frame or a bi-predictivepicture frame.

In one embodiment, the video that is sent includes a plurality of framesthat includes a first frame, a second frame, a third frame and a fourthframe. The first frame may include a mono-chromatic background with asuper imposed static code. The second frame may include a multi-coloredbackground with a super imposed static code. The third frame may includea moving multi-colored background with a super imposed code. The fourthframe may include a mono-chromatic static background with a movingsuperimposed code. The first and second frames may be intra-codedpicture frames, or I-frames, in some embodiments and the third andfourth frames may be predicted picture frames or bi-predictive pictureframes in some embodiments. In other embodiments, the first, second,third and fourth frames may each be one of an intra-coded picture frame,a predicted picture frame or a bi-predictive picture frame.

A method of testing quality of a received video is also provided. Themethod includes the steps of a first communication terminal receiving avideo transmitted by a communication device, the first communicationterminal extracting at least one code superimposed in at least one frameof the received video, the first communication terminal reading theextracted at least one code to evaluate at least one parameter of thereceived video indicative of a quality of the received video, and thefirst communication terminal determining a value for the at least oneparameter to identify a quality level of the received video.

Embodiments of the method may also include other steps. For instance,the first communication terminal may determine a level of distortion ofthe received video. The determination of the level of distortion mayoccur by the first communication terminal determining an amount of errorcorrection applied to read the extracted at least one code andcorrelating the amount of error correction applied to an amount ofdistortion.

The communication device that sent the video received by the firstcommunication terminal may be any of a number of different devices. Forinstance, the communication device may be a second communicationterminal. As another example, the communication device may be a switchdevice, an access point, or a network node.

The communication connection by which the video was received by thefirst communication terminal may be any of a number of differentconnections. For instance, the connection may be a direction connection.As another example, the connection may be a network connection or otherconnection defined by a transmission path having multiple hops viaintermediary devices such as network nodes or other types of networkelements.

A non-transitory computer readable medium having at least oneapplication stored thereon that is executable by a processor unit of acommunication terminal is also provided. The at least one application ofsuch a medium may define a method that comprises a number of steps. Forexample, the method may include the steps of the communication terminalextracting at least one code superimposed in at least one frame of areceived video, the communication terminal reading the extracted atleast one code to evaluate at least one parameter of the received videoindicative of quality of the received video, and the communicationterminal determining a value for the at least one parameter to identifya quality level of the received video. The steps of such a method mayalso include other steps in some embodiments of the computer readablemedium. For example, the method defined by the one or more applicationsmay include the step of the communication terminal determining a levelof distortion of the received video by determining an amount of errorcorrection applied to read each of the extracted at least one code andcorrelating the amount of error correction applied to an amount ofdistortion.

In one embodiment, the computer readable medium is a hard drive, flashdrive, a type of compact disc (“CD”) or a type of digital versatile disc(“DVD”), a floppy disc, or other memory of a communication terminal. Forinstance, an embodiment of the computer readable medium may be memory ofa communication terminal of an embodiment of our communication system.

Other details, objects, and advantages of the invention will becomeapparent as the following description of certain present preferredembodiments thereof and certain present preferred methods of practicingthe same proceeds.

BRIEF DESCRIPTION OF THE DRAWINGS

Present preferred devices, systems, and apparatuses for providingcommunications between multiple communication devices are shown in theaccompanying drawings and certain present preferred methods ofpracticing the same are also illustrated therein. It should beunderstood that like reference numbers used in the drawings may identifylike components.

FIG. 1 is a block diagram of an exemplary communication system. An arrowis illustrated in broken line to illustrate an optional or alternativedirect communication connection between the first and secondcommunication terminals. Such a direct communication connection may beformed via a wired transmission path defined by a cable or other wiringinterconnecting the two terminals or a direct wireless transmission pathformed via wireless transceivers of the terminals.

FIG. 2 is a flow chart illustrating an exemplary method for testingvideo quality.

FIG. 3 is a schematic view of an exemplary embodiment of a group ofpictures that may comprise a portion of a video. The group of picturesincludes a plurality of frames that comprise part of the video. Itshould be understood that the embodiment of the group of picturesillustrated in FIG. 3 may be transmitted using the embodiment of themethod illustrated in FIG. 2 and the embodiment of the systemillustrated in FIG. 1.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Referring to FIGS. 1-2, a first communication terminal 1 may communicatewith a second communication terminal 3 to send data via a connectionestablished between the terminals. Such data may include a videotransmitted in one or more data packets sent from the firstcommunication terminal 1 to the second communication terminal 3. Thevideo data may contain pictorial data such as one or more images andalso contain audio data. The communication connection establishedbetween the first and second communication terminals 1 and 3 may beformed via a network connection or via a direction connection. Forexample, the first communication terminal may be connected to a network4 and communicate with a switch device 6 for establishing a connectionwith the second communication terminal 3 and transmitting data to thesecond communication terminal 3. As an alternative example, the firstcommunication terminal 1 may have a communication connection establisheddirectly with the second communication terminal 3 as shown in brokenline in FIG. 1 via a wireless communication connection such as aBluetooth wireless communication path connection, a Wi-Fi wirelesscommunication connection path, or a wired transmission path connectionsuch as a universal serial bus (“USB”) interconnection.

It should be appreciated that the network 4 may include a number ofnetwork nodes such as access points, gateways, survivable proxy devices,border control elements, and other network elements that maycommunicatively connect with the communication terminals connected tothe network 4. For instance, each communication terminal may beconnected to the network via an access point (not shown) such as arouter or base station. It should also be appreciated that the network 4may be a local area network, wide area network, or cellular network. Theswitch device may be a server, a private branch exchange, a softswitch,or other computer device that facilitates the establishment of acommunication session or an establishment of a communication connectionsuch as a video call or a phone call. It should also be understood thata connection between the first and second terminals 1 and 3 may involvea transmission path defined by multiple network nodes such as, forexample, multiple access points and at least one switch device.

The first communication terminal 1 may include a processor unit 1 a thatis communicatively coupled to memory 1 c and a transceiver unit 1 b. Thememory 1 c may be non-transitory memory such as a hard drive, flashdrive or other memory. The memory 1 c may have at least one application1 d stored thereon and a plurality of predefined codes 1 e storedthereon. The processor unit 1 a may be configured to execute theapplication 1 d stored in the memory 1 c. The application 1 d may beconfigured to call the codes 1 e for including one or more codes inframes of a video when the application is executed by the processor unit1 a and may also be configured to create the codes for including in oneor more frames of a video when the application 1 d is executed. Theapplication 1 d may define steps of a method that the communicationterminal executes when the application is executed by the processor unit1 a. Steps of such a method may be appreciated from FIG. 2 and from thebelow. Such steps may each be defined by program code that may definethe application 1 d.

The transceiver unit 1 b may be configured to include one or morereceiver units and one or more transmitter units for transmitting andreceiving data. For instance, the transceiver unit 1 b may be configuredto communicate with the network 4 and to also directly communicate witha transceiver unit of the second communication terminal 3 for forming adirect connection between the terminals shown in broken line in FIG. 1.The first communication terminal 1 may also include one or more inputdevices and one or more output devices communicatively connected to theprocessor unit 1 a. For instance, a camera sensor, a keyboard, a touchscreen display unit, a microphone, and a speaker may each becommunicatively connected to the processor unit 1 a. The input devicesmay be used to record video and audio and transmit such recorded audioand video. For instance, the camera sensor and microphone may recordaudio and video for saving in the memory 1 c. The recorded audio andvideo may then be transmitted via the transceiver unit 1 b.

The second communication terminal 3 may include a processor unit 3 athat is communicatively coupled to a transceiver unit 3 b and memory 3c. The memory 3 c may be non-transitory memory such as a hard drive,flash drive or other memory. The memory 3 c may include at least oneapplication 3 d and codes 3 e. The processor unit 3 a may be configuredto execute the application 3 d stored in the memory 3 e. The application3 d may define steps of a method that the communication terminalexecutes when the application is executed by the processor unit 3 a.Steps of such a method may be appreciated from FIG. 2 and from thebelow. Such steps may each be defined by program code that may definethe application 3 d. The second communication terminal 3 may alsoinclude one or more input devices and one or more output devicescommunicatively connected to the processor unit 3 a. For instance, acamera sensor, a keyboard, a touch screen display unit, a microphone,and a speaker may each be communicatively connected to the processorunit 3 a. The input devices may be used to record video and audio andtransmit such recorded audio and video. For example, the camera sensorand microphone may be used to record audio and video for saving in thememory 3 c. The recorded audio and video may then be transmitted via thetransceiver unit 3 b.

The first communication terminal 1 may send video and audio data to thesecond communication terminal 3 via a connection established between theterminals. As shown in FIG. 1, such a connection may be via a networkconnection that utilizes multiple network nodes such as one or moreaccess points and one or more switch devices. Alternatively, such aconnection may be a direct connection between the terminals, such as awired transmission path that is only between the two terminal devices ora wireless transmission path that only includes the two terminals.

The video that is sent via the connection may be comprised of aplurality of frames of images. The video may have been contemporaneouslycaptured via the camera sensor and stored for transmission as done in avideo call or may be a video previously stored for transmitting, as donein an electronic mail transmission such as an e-mail or short messagingservice message, such as a text message.

Each frame of the video that is sent may have a separate image. Theseries of frames may be in a predefined order to define the video. Theframes of the video may each define a complete image captured during aknown time interval or predefined time period. For instance, each frameof the video may be an intra-coded picture frame, which may also becalled an I-frame. Some of the frames may alternatively includepredicted picture frames, which are also known as P-frames ordelta-frames. Such frames may also include bi-predictive picture frames,which are also known as B-frames. The frames of the video may alsoinclude a combination of I-frames, B-frames, and P-frames. The recordedvideo may be encoded with just I-frames, a combination of I-frames andB-frames, a combination of P-frames and I-frames, a combinationI-frames, B-frames, and P-frames, or any other combination of suchframes when recorded, when encoded, or may otherwise be so formattedprior to being transmitted. The use of P-frames and B-frames within thevideo may be used to reduce the amount of memory needed for saving thevideo as the use of such frames can adjust the amount of memory spaceneeded for saving the video or may be used to reduce bandwidthrequirements for transmission of the video as the use of P-frames andB-frames can reduce the amount of bandwidth needed for transmitting thevideo.

On example of a portion of a video that may be sent for testing purposesis shown in FIG. 3. The portion of the video may be a group of pictures30 that includes a plurality of frames of the video. The frames mayinclude a first frame that is an I-frame 31, a second frame that is aB-frame 32, a third frame that is a B-frame 33, a fourth frame that is aP-frame 34, a fifth frame that is a B-frame 35, a sixth frame that is aB frame 36 and a seventh frame that is a P-frame 37. The group ofpictures 30 may include all seven of these frames in sequential order asshown in FIG. 3.

The I-frame 31 may be decoded for display without requiring any decodingof any preceding frames. As shown by the arrows illustrated in FIG. 3 toindicate points of reference for the decoding of the frames, the B-frame32 may require the decoding of the I-frame 31 before it can be decodedas a reference point for the decoding of the B-frame. The B-frame 33 mayrequire the I-frame 31 and the B-frame 32 to be decoded first as pointsof reference for decoding the B-frame 33. The P-frame 34 may alsorequire the decoding of the I-frame 31 and the B-frame 32. The B-frame35 may require the P-frame 34 to be decoded as a point of referencebefore that frame can be decoded. B-frame 36 may require the P-frame 34to be decoded as a point of reference for the decoding of B-frame 36.The P-frame 37 may require the P-frame 34, and B-frames 35 and 36 to bedecoded as points of reference for the decoding of the P-frame. Itshould be appreciated that the B-frames and P-frames require one or moreother frames to be decoded for predictive decoding to occur.

Prior to sending the video, the first communication terminal 1 maysuperimpose at least one code onto at least one frame of the video. Eachof the codes may represent a respective quality level and includeindicia or other information indicating a quality level. One example ofthe codes that may be superimposed is a quick response code, which isalso known as a QR code. A QR code is a type of two dimensional bar codethat stores information in both a vertical path and a horizontal path ofa bar code symbol defining the code. Another example of a type of codethat may be used for superimposing on one or more frames of the videothat is to be sent is a three dimensional bar code, which is alsoreferred to as a bumpy bar code. An example of superimposing one or morecodes may be to overlay one or more code images on a picture of a frameof the video or a portion of the picture of the frame of the video.

For example, the processor unit 1 a of the first communication terminal1 may superimpose at least one code on a picture of an I-frame of thevideo to be sent. At least one code may be overlaid on a chart, a graph,an image, a presentation slide, or other picture of the I-frame, forexample. The video with the superimposed one or more codes may then beencoded for transmission and transmitted to the second communicationterminal 3. The second communication terminal 3 may receive the sentencoded video and decode the received video and subsequently extract anysuperimposed codes from that video. For instance, the processor unit 3 aof the second communication terminal 3 may execute one or moreapplications that permit the second communication terminal to identifywhich frames of the video include any superimposed codes and extractthose superimposed codes.

The at least one code that is extracted from the video may then betested by the second communication terminal 3 to determine what thevideo quality level of the transmitted video is. The determination mayresult in determining the video quality such as a resolution level ofthe video or a frame rate of a video. The frame rate of a video may alsobe referred to as a frame frequency of a video. The frame rate may beyet another video quality parameter indicative of a quality of the videoas the more frames per unit time (e.g. second, minute, etc.). the betterthe video will typically appear to a user when the video is output asthe higher frame rate can reduce motion blur or flickering that mayoccur during video output of video at slower frame rate.

The second communication terminal 3 may determine that the resolutionlevel of the video or other video parameter indicating a video qualitylevel is low relative to the originally encoded video that was encodedby the first communication terminal 1 by determining that only afraction of the total number of superimposed codes were readable by thesecond communication terminal 3 after extraction of the one or morecodes from that video. If the transmission path along which the videowas transmitted included one or more network nodes of a networkconnection between the first and second communication terminals, thesecond communication terminal 3 may then determine the distortion of thereceived video caused by intermediary nodes position in the transmissionpath between the first and second communication terminals 1 and 3 byassessing the error correction of the extracted one or more codes.

The second communication terminal 3 may then remove the superimposedcodes from the frames of the video and then output the video via adisplay unit of the second communication terminal 3, such as a touchscreen display, liquid crystal display, or monitor that iscommunicatively coupled to the processor unit 3 a of the secondcommunication terminal 3. Alternatively, the video may be output withoutremoving the one or more superimposed codes. As the codes may only be ona few frames of the video, the codes may not be noticeable when outputas a video by human eyes watching the video via an output device of thesecond communication terminal 3 or communicatively connected to theprocessor unit 3 a of the second communication terminal 3.

It is contemplated the embodiments of the first and second communicationterminals 1 and 3 may include applications that are configured to definereading and creating of codes that may be superimposed and extractedfrom videos for transmitting and receiving a video. For example, anopens source application such as Zebra Crossing software distributed byGoogle Inc. or other barcode creation and decoding software may beutilized by storing it in memory and having a processor unit execute theapplication for extracting a code from a video or creating a code forsuperimposing the code in the video prior to transmitting the video.

The processor unit of the communication terminal sending a video may beconfigured to run an application stored on its memory, such asGraphicsMagick software that is distributed by GraphicsMagick Group forexample, that permits the processor unit to perform an overlay function,which may also be called a Coalesce command. Of course, other softwaremay be utilized as an alternative to the GraphicsMagick application. Thecommunication terminal may overlay one or more codes upon execution ofsuch an application. User input may also be provided via one or moreinput devices communicatively connected to the processor unit of thecommunication terminal for creating codes, superimposing the codes, orfor extracting the codes. It should be appreciated that any of a numberof formats to the code or codes superimposed in a frame of a video maybe used. UPC-A barcode format, UPC-E barcode format, EAN-8 barcodeformat, EAN-13 barcode format, Code 39 barcode format, Code 93 barcodeformat, Code 128 barcode format, ITF barcode format, Codabar barcodeformat, RSS-14 or an RSS-14 variant barcode format, Data Matrix barcodeformat, Aztec barcode format, PDF 417 barcode format, or a quickresponse code barcode format may be used for example.

Each code that is superimposed in a frame of a video may also beconfigured to provide error correction capability. For instance, somecodes are configured so that data stored in the code may be restoredeven if the symbol is partially dirty or damaged upon decoding of thecode or extraction of the code. The use of a quick response code formatmay be currently preferred over other types of formats because quickresponse codes are capable of omni-directional high speed reading thatutilizes position detection patterns located at different corners of acode symbol, which can help guarantee a stable high speed reading andcircumvent negative effects of background interference that could occurfrom the code being overlaid on another image. Quick response code mayalso be divided into multiple data areas so that multiple symbols of aquick response code may be reconstructed as a single data symbol. Whilea quick response code format may provide some advantages relative toother code options, it should be understood that any of a number of codeoptions may be utilized in different embodiments to meet any of a numberof possible design objectives.

The communication terminals that send and receive a transmitted video,such as the first and third communication terminals 1 and 3, may utilizeone or more testing methodologies for assessing one or more parametersthat are indicative of the video quality of the transmitted and receivedvideo. For instance, a mono-chromatic background with super imposedstatic code may be one frame that is sent in a video to anothercommunication terminal for evaluation of the code contained therein.Additionally, a multi-colored background with a super imposed staticcode may be used in a frame of the video that is sent for extraction andevaluation by the recipient communication terminal. Other frames thatinclude superimposed codes for testing may include vertically,horizontally, or diagonally sliding multi-colored background withsuperimposed code, and one or more frames including mono-chromaticstatic background with vertically, horizontally, diagonally slidingsuperimposed code. I-frames may be used for static background and staticcode frames. P-frames and B-frames may be utilized for the slidingbackground test frames or the moving background test frames. The videosending communication terminal, such as the first communication terminal1, may create the different test frames for inclusion in the sent videoand encode the video for transmission. The receiving communicationterminal, such as the second communication terminal 3, may then receivethe video and review the test frames for evaluating the frames anddetermining at least one parameter indicative of the video quality ofthe received video.

One example of the first and second communication terminals utilizing apredetermined testing methodology may be the first communicationterminal sending a message with a parameter indicating which one of anumber of different testing methodologies is to be used by the secondcommunication terminal for assessing video to be sent to the secondcommunication terminal. In some embodiments, that parameter may indicatea methodology that requires the decoding of just one frame that includesa plurality of codes to be extracted and decoded or may alternatively bea methodology that includes the sending of multiple frames in asequential order that each include one code for extraction and decoding.The methodology that is selected may be utilized for identifying errorand error level in addition to determining the quality of video that istransmittable over the communication path defined between the first andsecond communication terminals.

For example, if only one frame is to have codes superimposed therein,the first of the superimposed codes may have a larger code thatindicates a highest video resolution and there may be additional codesthat are each of a smaller size than a prior code and indicate a lowervideo resolution. For example, the first frame may include three codes,the first code may have a first content that is of a largest size, thesecond code may include the same content but be of an intermediate sizethat is smaller than the largest size and the third code may have thesame content as the first and second codes, but be of a smallest size.The second communication terminal 3 may extract all the codes from theframe and try to read those codes. If the third code or second code wasnot readable or detectable, then the amount of error correction used todecode that third code or second code may be used to identify the errorand level of error involved in the transmission of the video over thetransmission path. Of course, the number of codes used in the frame maybe a number much larger than 3 codes to provide a better indication foridentifying a level of error correction utilized for reading codesextracted from the received video for use in determining a level oferror that occurs for transmission of video over the communication pathdefined between the first and second communication terminals fortransmitting the video.

As another example of a testing methodology that may be utilized by thefirst and second communication terminals 1 and 3, one code may be brokeninto different fragments, or portion and subsequently superimposed intomultiple frames of a video sent to the second communication terminal forextraction. The entire code may only be obtained after extraction of allthe fragments from all the sent frames. The fragments from one code thatare sent in a group of pictures 30 of a video may be sent so that afirst fragment of the code is included in an I-frame 31, a secondfragment is included in B-frame 32, a third fragment is included inB-frame 33, a fourth fragment is included in P-frame 34, a fifthfragment is included in B-frame 35, a sixth fragment is included inB-frame 36 and a seventh fragment is included in P-frame 37. Thedetection of the code transmitted with the video may only occur uponextracting all seven fragments from the frames. Each group of pictures30 may include frames that have a fragment from multiple different codesso that multiple codes may be extracted from the group of pictures 30.Each of the codes may include different content and be of a differentsize. The largest code that is extractable and readable by the secondcommunication terminal 3 may indicate the best quality of videoreceivable via the transmission path along which that group of pictures30 was sent by the first communication terminal.

As yet another example of a testing methodology that may be utilized bythe first and second communication terminals 1 and 3, the firstcommunication terminal 1 may send an intentionally corrupted code thatcan or cannot be decoded by the second communication terminal 3 usingerror correction code. The most corrupted code that is readable by thesecond communication terminal may indicate the video quality of thevideo receivable by the second communication terminal 3.

As yet another example of a testing methodology that may be utilized bythe first and second communication terminals, a combination of any ofthe above mentioned testing methodologies may be utilized. For instance,a first group of pictures may be utilized for detecting a best orhighest resolution video quality for a video transmittable along thetransmission path between the first and second communication terminals.A second group of pictures may be included in that video and beconfigured for detecting an error level involved in the transmission ofthe video. A third group of pictures may be sent for identifying a framerate, such as how many frames are moved per second of the video.

If the transmission path between the sending and receiving communicationterminals includes one or more intermediary nodes, such as a networknode (e.g. an access point, a switch device 6, etc.), the evaluation ofthe received video performed by the receiving communication terminalsuch as the second communication terminal 3 may also include a detectionof code distortion. The amount of error correction applied to eachsuperimposed code may be correlated with a level of distortion to assessthe impact the intermediate nodes had on the video quality of thereceived video. The level of distortion may result from any of the nodesdropping data packet or corrupting a data packet of the video sentduring the transmission of the video from the first communicationterminal 1 to the second communication terminal 1. If any of the nodesare active nodes, they may also add to distortion by decoding andencoding or transcoding the video during the transmission of the video.An example of an active node would be a media server or a conferenceserver that be use used in a communication between the communicationterminals. Such devices may provide a media protocol conversation forexample and be used to alter the protocol of the transmitted video fromone terminal to another terminal. For example, such an active node mayconvert video sent in accordance with H.264 protocol to video in VP8protocol and vice versa.

It should be understood that the H.264 protocol is a protocol standardfor video compression that was developed by with the InternationalOrganization for Standardization (ISO)/International ElectrotechnicalCommission (IEC) joint working group, the Moving Picture Experts Group(MPEG). The product of this partnership effort is known as the JointVideo Team (JVT). The ITU-T H.264 standard and the ISO/IEC MPEG-4 AVCstandard (formally, ISO/IEC 14496-10—MPEG-4 Part 10, Advanced VideoCoding) are jointly maintained so that they have identical technicalcontent. The VP8 is an open video compression format that is currentlyowned by Google, Inc.

In some embodiments of our method, apparatus, and system, the testing ofthe received video that is performed by the receiving communicationterminal such as the second communication terminal may only be performedupon the establishment of the connection. For example, the firstcommunication terminal may send a first video to the secondcommunication terminal for testing purposes for establishing aconnection for transmitting a second video to the second communicationterminal such as video for a video conference or video for a telecast orbroadcast. The first video may be a predefined video that includesdifferent slides with superimposed or overlaid codes for testingpurposes as discussed above. The codes used in the first video may beaccording to a predefined plan so that the receiving communicationterminal can correlate the received codes that are readable with one ormore parameters to detect a quality of the received video. If thequality meets a predetermined quality threshold by being at or exceedingat least one video quality parameter level such as a predefinedresolution level and a predefined frame rate, the connection may bemaintained or the establishment of the connection may be completed.

If the quality level fails to meet the desired level, the establishmentof the connection may be continued by creating a new connection paththat uses an alternative transmission path to attempt to obtain a betterquality video or the second communication terminal 3 may report dataindicating the insufficient quality level for the connection to theswitch device 6 or a media server or bandwidth manager so that furtherresources may be allocated to the connection sought to be establishedand formed between the first and second communication terminals 1 and 3.If a message reporting on the insufficiency of the connection is sent toa network node or network element for allocating more network resourcesto the connection to address the identified insufficiency, the networkelement may then send a response to the first and second communicationterminals 1 and 3 indicating that further resources have been providedto the connection so that the communication terminals may reinitiate thesending of video for testing the video quality of the video transmittedover the connection sought to be established. The new resources may bean allocation of additional bandwidth or a reassigning of nodes alongwhich a transmission path is defined within the network 4 that definesthe connection between the first and second communication terminals 1and 3. Alternatively, the network element may respond to thecommunication terminals 1 and 3 to inform the terminals that no furtherresources are available.

Embodiments of our apparatus, system and method may also be used forother purposes. For instance, video quality testing may be utilized forfinding flaws in a communication network as part of maintenance andupgrading of a network, such as a private enterprise network.Communication terminals may transmit video for testing purposes toidentify active and passive nodes within a network that need upgradingor that need replaced, for example. The testing could also be utilizedto identify network performance issues or identify congestion pointswithin an enterprise network that affects video transmissioncapabilities at certain times of day. As yet another example, suchtesting may be utilized to measure network load and performance forpurposes of identifying metrics for use in maintaining a desired networkload or network performance level.

It should be understood that embodiments of the system, communicationterminals, and methods discussed above may be variously implemented tomeet different design objectives. For instance, the communicationterminals may be any of a number of different types of communicationendpoints such as desktop computers, mobile telephones, cellular phones,personal digital assistants, tablets, laptop computers, internetappliances, or other communication computer devices configured tosending or receiving video. As another example, the network 4 may be alocal area network, a cellular network, or may be any of a number oftypes of wide area networks such as the internet or an enterprisenetwork. As yet another example, the format for codes used in thesuperimposing and extraction of video may be selected from any of anumber of different codes formats or includes the use of a combinationof different code formats. As yet another example, the informationcontained in the codes to indicate a quality level or parameterassociated with a quality level of a received video may include any of anumber of types of information and the included information may bedefined according to a predefined schema so that information containedin the code corresponds to a particular quality level or valueindicating of video quality. The information contained within a code mayalternatively be defined so that when the code is read the informationprovided by the code identifies a quality level of the received video tothe receiving communication terminal.

While certain present preferred embodiments of a communication terminal,non-transitory computer readable medium executable by a communicationterminal, a communication system, and methods of making and using thesame have been shown and described above, it is to be distinctlyunderstood that the invention is not limited thereto but may beotherwise variously embodied and practiced within the scope of thefollowing claims.

What is claimed is:
 1. A communication apparatus comprising: a firstcommunication terminal having a processor communicatively connected tonon-transitory memory; the first communication terminal configured tosuperimpose at least one code within at least one frame of a video to besent to a second communication terminal and subsequently send the videowith the at least one frame having the at least one superimposed code tothe second communication terminal; wherein the video with the at leastone frame having the at least one superimposed code comprises at leastone of: a first frame comprising a mono-chromatic background with asuper imposed static code, a second frame comprising a multi-coloredbackground with a super imposed static code, a third frame comprising amoving multi-colored background with a super imposed code, and a fourthframe comprising a mono-chromatic static background with a movingsuperimposed code.
 2. The communication apparatus of claim 1 comprisingthe second communication terminal connected to the first communicationterminal.
 3. The communication apparatus of claim 2, wherein the firstcommunication terminal is connected to the second communication terminalvia a direct connection between the first and second communicationterminals.
 4. The communication apparatus of claim 2, wherein the videois to be sent prior to establishing a video call or a video conferencecall to determine a resolution level of the video to be transmittedduring the video call or the video conference call.
 5. The communicationapparatus of claim 2, wherein the at least one code is comprised of aquick response code and the at least one frame is a plurality of framesand wherein the at least one code superimposed in the at least one frameis comprised of the quick response code being separated into a pluralityof fragments and each of the fragments being superimposed in arespective one of the frames.
 6. The communication apparatus of claim 2,wherein the apparatus is a communication system.
 7. The communicationapparatus of claim 1, wherein the at least one code is comprised of aquick response code and the at least one frame is a plurality of framesand wherein the at least one code superimposed in the at least one frameis comprised of the quick response code being separated into a pluralityof fragments and each of the fragments being superimposed in arespective one of the frames.
 8. The communication apparatus of claim 1,wherein the video is comprised of the first and second frames, the firstframe being an intra-coded picture frame of the video and the secondframe being an intra-coded picture frame of the video.
 9. Thecommunication apparatus of claim 8, wherein the video is also comprisedof the third frame, the third frame being a predicted picture frame ofthe video or a bi-predictive picture frame of the video.
 10. Thecommunication apparatus of claim 9, wherein the video is also comprisedof the fourth frame, the fourth frame being a predicted picture frame ofthe video or a bi-predictive picture frame of the video.
 11. Thecommunication apparatus of claim 8, wherein the video is also comprisedof the fourth frame, the fourth frame being a predicted picture frame ofthe video or a bi-predictive picture frame of the video.
 12. Thecommunication apparatus of claim 1, wherein the video is comprised ofthe third frame, the third frame being a predicted picture frame of thevideo or a bi-predictive picture frame of the video.
 13. Anon-transitory computer readable medium having at least one applicationstored thereon that is executable by a processor of a firstcommunication terminal, the at least one application defining a methodcomprising: superimposing at least one code within at least one frame ofa video to be sent to a second communication terminal for subsequentlysending the video with the at least one frame having the at least onesuperimposed code to the second communication terminal; wherein thevideo with the at least one frame having the at least one superimposedcode comprises at least one of: a first frame comprising amono-chromatic background with a super imposed static code, a secondframe comprising a multi-colored background with a super imposed staticcode, a third frame comprising a moving multi-colored background with asuper imposed code, and a fourth frame comprising a mono-chromaticstatic background with a moving superimposed code.
 14. Thenon-transitory computer readable medium of claim 13, wherein the videois to be sent prior to establishing a video call or a video conferencecall to determine a resolution level of the video to be transmittedduring the video call or the video conference call, and the method alsocomprises sending the video with the at least one frame having the atleast one superimposed code to the second communication terminal. 15.The non-transitory computer readable medium of claim 13, wherein the atleast one code is comprised of a quick response code and the at leastone frame is a plurality of frames and wherein the at least one codesuperimposed in the at least one frame is comprised of the quickresponse code being separated into a plurality of fragments and each ofthe fragments being superimposed in a respective one of the frames. 16.The non-transitory computer readable medium of claim 13, wherein the atleast one code is comprised of a quick response code and the at leastone frame is a plurality of frames and wherein the at least one codesuperimposed in the at least one frame is comprised of the quickresponse code being separated into a plurality of fragments and each ofthe fragments being superimposed in a respective one of the frames. 17.The non-transitory computer readable medium of claim 13, wherein thevideo is comprised of the first and second frames, the first frame beingan intra-coded picture frame of the video and the second frame being anintra-coded picture frame of the video.
 18. The non-transitory computerreadable medium of claim 17, wherein the video is also comprised of thethird frame, the third frame being a predicted picture frame of thevideo or a bi-predictive picture frame of the video.
 19. Thenon-transitory computer readable medium of claim 18, wherein the videois also comprised of the fourth frame, the fourth frame being apredicted picture frame of the video or a bi-predictive picture frame ofthe video.
 20. The apparatus of claim 17, wherein the video is alsocomprised of the fourth frame, the fourth frame being a predictedpicture frame of the video or a bi-predictive picture frame of thevideo.